Informed Source Separation of Orchestra and Soloist

نویسندگان

  • Yushen Han
  • Christopher Raphael
چکیده

A novel technique of unmasking to repair the degradation in sources separated by spectrogram masking is proposed. Our approach is based on explicit knowledge of the musical audio at note level from a score-audio alignment, which we termed Informed Source Separation (ISS). Such knowledge allows the spectrogram energy to be decomposed into note-based models. We assume that a spectrogram mask for the solo is obtained and focus on the problem of repairing audio resulting from applying the mask. We evaluate the spectrogram as well as the harmonic structure of the music. We either search for unmasked (orchestra) partials of the orchestra to be transposed onto a masked (solo) region or reshape a solo partial with phase and amplitude imputed from unmasked regions. We describe a Kalman smoothing technique to decouple the phase and amplitude of a musical partial that enables the modification to the spectrogram. Audio examples from a piano concerto are available for evaluation.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Informed source separation of orchestra and soloist using masking and unmasking

A novel technique of unmasking to repair the degradation in sources separated by spectrogram masking is proposed. Our approach is based on explicit knowledge of the musical audio at note level from a score-audio alignment, which we termed Informed Source Separation (ISS). Such knowledge allows the spectrogram energy to be decomposed into note-based models. We assume that a spectrogram mask for ...

متن کامل

Production, convention and power: Constructing the sound of an Early Music orchestra

By explaining how an Early Music orchestra produces its sound, we can review Howard Becker’s concept of a convention. An orchestra’s sound depends on principles incorporated in things (musical instruments, scores) and bodies (musicians’ techniques). A common set of principles about interpret-ing a piece of music — principles acquired well before any rehearsal — do not suffice for coordinat-ing ...

متن کامل

Source Separation By Score Synthesis

A musical score provides a great deal of information about a piece of music. In this paper we consider the incorporation of a music score to guide source separation on a single channel recording. We propose a method based on synthesizing lines of music in the score. Dynamic time warping (DTW) is used to to fit the synthesized data to the recording. These are then used as prior distributions in ...

متن کامل

Real - Time Pitch Detection

Finally, there is a definition problem between monophonic and polyphonic sounds. In the case of monophonic sound, the obvious definition is to pick the lowest partial as the fundamental frequency. In the case of polyphonic sounds, resulting either from one source (e.g., a piano) or from many sources (e.g., orchestra, choir), the definition is far more difficult, and approaches close to the prob...

متن کامل

30349_ MEI Journal

The Hyperinstruments research group at the MIT Media Lab in Cambridge, Massachusetts, USA. developed a number of technology-based instruments and a piece of graphical software for composition for children in the 8-12 year age range. The ‘Toy Symphony’ project gave children in various cities in Europe and the USA access to these technologies during a series of workshops and culminated in a publi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010